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DETAILED ACTION 



Response to Arguments 

1 . Applicant's arguments with respect to claims 1 , 3-4, 6-7, 9-10, 12-26 have been 
considered but are moot in view of the new ground(s) of rejection. 

2. Applicants submitted that Okuno* does not teach complementing a language part 
to the fragment of when a filled pause is detected. A filled pause as described by the 
Applicants is a word with prolonged and vocalized sound. Words such as "uh...", "urn..." 
etc. include filled pause (Applicants: p. 5, 11.1-6). Okuno teach such words for triggering 
speech complement. As an example, a user speaks the phrase "Tokyo/honyalala/Hotel" 
meaning "Tokyo/something/Hotel". The wild card expression "honyalala" includes a 
filled pause, that is, it is a word with prolonged and vocalized sound (Okuno: p. 16, If 
0045, 11.5-9) and the word length is adjustable by the number 'la' (Okuno: p. 15, U 0043; 
see also Fig. 3 & 7). This word is for triggering speech complement, i.e., the word is to 
be replaced or substituted by a known word such as "Stayin" from the vocabulary 
storage part 102 to complete the phrase "Tokyo Stayin Hotel" (Okuno: p. 15, H 0044; 

p. 18, H 0052). The speech recognition system of Okuno targets the speech recognition 
of continuous words (Okuno: p. 14, U 0039, last 4 lines) and The words "Tokyo" and 
"Hotel" are fragments (e.g., parts of a sentence: p.8, U 0015-0017) of a spoken 
language which is no different than the fragments of the spoken language described by 
the Applicants (Applicants: p.7, 11.17-27; p.8, 11.1-22). 
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*Note: Takehide Yano was translated by the automatic translation system of Japan 
Patent Office as the name of one of the inventors in reference JP 1 1-095793 which was 
used in the original office action. However, the official translation is Takehide Okuno. 

Claim Rejections - 35 USC §112 

3. The following is a quotation of the first paragraph of 35 U.S.C. 112: 

The specification shall contain a written description of the invention, and of the manner and process of 
making and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the 
art to which it pertains, or with which it is most nearly connected, to make and use the same and shall 
set forth the best mode contemplated by the inventor of carrying out his invention. 

4. Claim 25 is rejected under 35 U.S.C. 112, first paragraph, as failing to comply 
with the written description requirement. The claim(s) contains subject matter which 
was not described in the specification in such a way as to reasonably convey to one 
skilled in the relevant art that the inventor(s), at the time the application was filed, had 
possession of the claimed invention. 

As best understood from the specification of the instant application, speech 
forward complementing is performed after detecting the presence of a filled pause (p.6, 
II. 20-27; p. 7, 11.1-16). Therefore, the feature "executing speech forward complementing 
when said filled pause is not present", as claimed in part (g) of this claim, is not 
supported in the original disclosure. If the Applicant is content that such limitation is 
disclosed in the original disclosure, the examiner requests that the Applicant provides 
specific references in the disclosure to support the added limitation "executing speech 
forward complementing when said filled pause is not present". 
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5. Claim 25 is rejected under 35 U.S.C. 112, first paragraph, as failing to comply 
with the enablement requirement. The claim(s) contains subject matter which was not 
described in the specification in such a way as to enable one skilled in the art to which it 
pertains, or with which it is most nearly connected, to make and/or use the invention. 

Part (g) of claim 25 recites the limitation "executing speech forward 
complementing when said filled pause is not present". As best understood from the 
specification of the instant application, speech forward complementing is performed 
after detecting the presence of a filled pause (p.6, II.20-27; p.7, 11.1-16). Therefore, it is 
not clear how speech forward complementing is executed when a filled pause is not 
present. 

Claim Rejections - 35 USC § 102 

6. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 



7. Claims 1, 3-4, 6-7, 9-10, 12-18, 20, 24-26 are rejected under 35 U.S.C. 102(b) as being 
anticipated by Okuno et al. (Official English translation of Japan patent publication 11-095793, hereinafter 
"Okuno"). 


Claim(s) 
1 


Okuno discloses: 

A speech complementing apparatus comprising: 

means for repeatedly and continuously detecting whether or not there is a filled pause 
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(e.g., presence/absence of wild card expression "honyalala": p.18, U 0050) in a user's speech, 
wherein said filled pause (e.g., "honyalala") is a trigger for complementing (e.g., replacing or 
substituting known word or words into the wild card expression: p.1 5, 0044); 
{1. The wild card expression "honyalala", meaning "something", includes a filled pause, i.e., it 
is word with prolonged and vocalized sound ("lata") (p. 16, % 0045, 11.5-9) and it's length is 
adjustable by the number of 'la 1 (p. 15, U 0043; Fig. 3 & 7). 

2. Repeatedly detecting whether or not there is a filled pause is performed in the case where 
multiple wild card expressions appearing in a spoken phrase, (p.41, 0151)} 

means for recognizing said user's speech (e.g., "Tokyo honyalala Hotel" meaning 
"Tokyo something Hotel") in parallel with said detecting whether or not there is said filled 
pause (e.g., presence/absence of wild card expression); (p. 16, U 0044; p. 18, 0051) 

means for complementing a language part (e.g., replacing the wild card expression 
"honyalala" with the word "Stayin": p. 18, 0052) to the fragment of the language 
(e.g. /Tokyo", "Hotel" of "Tokyo honyalala Hotel") spoken by the user when said filled pause is 
detected (e.g., presence of wild card expression) by said means for detecting; (p.22, 0069) 
and 

{3. The words "Tokyo", "Hotel" are fragments of the language, e.g., parts of a sentence, 
spoken by the user, (p.8, H 0015-0017)} 

means for outputting a result of recognizing by said means for recognizing when no 
filled pause was detected, (p.18, 0050, II.4-5; see also p.49, Fig.14: S201, S202, S203) 


Claim(s) 
2 


(canceled). 


Claim(s) 
3 


Okuno discloses: 

The speech complementing apparatus as claimed in claim 1 , wherein said means for 
complementing complements said language part after said filled pause with a clue (e.g., 
"Tokyo", p. 15, If 0043), which is a fragment before-said filled pause (e.g., "honyalala") of the 
speech (e.g., "Tokyo honyalala Hotel"), when said filled pause was detected. 


Claim(s) 
4 


Okuno discloses: 
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The speech complementing apparatus as claimed in claim 1 , wherein in said means 
for complementing considers a specified key-word (e.g., "Stayin") as a specified string to 
replace a specific key-word (e.g., "honyalala") based on a relation (e.g., metrical information 
such as the rhythm of the input speech) of words around the specific key-word, when 
responding to said specific key-word including said filled pause, (p.22, 1J 0069; p.23, 0071) 


Claim(s) 
5 


(canceled). 


Claim(s) 
6 


Okuno discloses: 

The speech complementing apparatus as claimed in claim 4, further comprising: 

output means for outputting a list of candidates for complementing when there are a 
plurality of candidates for complementing; (p.22, U 0069, 11.8-1 1) and 

input receiving means for receiving a selection from the user of said plurality of 
candidates, (p.33, H 0107, II.6-9) 

wherein when there is only one candidate, the apparatus performs one of: asking the 
user's confirmation with said output means, or inputting automatically the one candidate 
(p.22, A 0069, 11.1-8). 


Claim(s) 
7 


Okuno discloses: 

A speech complementing method wherein a system recognizes a user's speech, said 
method comprising: 

(a) detecting repeatedly and continuously whether or not there is a filled pause (e.g., 
presence/absence of wild card expression "honyalala": p. 18, U 0050) in the user's speech, 
wherein said filled pause is a trigger for complementing (e.g., replacing or substituting known 
word or words into the wild card expression: p. 15, 0044); 

{1. The wild card expression "honyalala", meaning "something", includes a filled pause, i.e., it 
is word with prolonged and vocalized sound ("lata") (p. 16, U 0045, 11.5-9) and it's length is 
adjustable by the number of la' (p. 15, 1f 0043; Fig.3 & 7). 

2. Detecting repeatedly whether or not there is a filled pause is performed in the case where 
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multiple wild card expressions appearing in a spoken phrase, (p.41, U 0151)} 

(b) recognizing said user's speech (e.g., "Tokyo honyalala Hotel" meaning "Tokyo 
something Hotel") in parallel with (a); (p. 16, H 0044; p.18, U 0051) 

(c) complementing a language part (e.g., replacing the wild card expression 
"honyalala" with the word "Stayin": p. 18, H 0052) to a fragment of the language (e.g., "Tokyo", 
"Hotel" of "Tokyo honyalala Hotel") spoken by the user by said system when said filled pause 
is detected (e.g., presence of wild card expression); (p. 22, U 0069) and 

{3. The words "Tokyo", "Hotel" are fragments of the language, e.g., parts of a sentence, 
spoken by the user, (p.8, 0015-0017)} 

(d) outputting a result of said recognizing when no filled pause is detected, (p. 18, 
0050, II.4-5; see also p.49, Fig. 14: S201, S202, S203) 


Claim(s) 
8 


(canceled). 


Claim(s) 
9 


Okuno discloses: 

The speech complementing method as claimed in claim 7, wherein (c) comprises 
complementing the language part following said filled pause with a clue (e.g., "Tokyo", p. 15, U 
0043) which is a fragment of the user's speech (e.g., "Tokyo honyalala Hotel") occurring 
before said filled pause (e.g., "honyalala"). 


Claim(s) 
10 


Okuno discloses: 

The speech complementing method as claimed in claim 7, wherein responding to a 
specific key-word (e.g., "honyalala") including said filled pause, the specified key-word (e.g., 
"Stayin") is considered as a specified string to replace the specific key-word (e.g., "honyalala") 
based on a relation (e.g., metrical information such as the rhythm of the input speech) of 
around the specific key-word, (p.22, 0069; p.23, 0071 ) 


Claim(s) 
11 


(canceled). 


Claim(s) 


Okuno discloses: 
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12 


The speech complementing method as claimed in claim 7, wherein (c) further 
comprises: 

outputting a list of the candidates for complementing to a screen (e.g., a computer 
screen: p.40, U 0148) or in audio form, when there are a plurality of candidates for 
complementing; (p.22, U 0069, 11.8-11) 

receiving a selection of said plurality of candidates from said user; (p.33, 0107, II.6- 

9) and 

when there is only one candidate, performing one of: asking confirmation of said only 
one candidate from said user, or inputting said only one candidate automatically (p.22, 
0069, 11.1-8). 


Claim(s) 
13 


Okuno discloses: 

A recording medium (e.g., CD-ROM: p.40, H 0148) which stores a program executed 
in a complementing apparatus, said program comprising: 

a speech input step (p.44, Fig.1: 100) for inputting a speech (e.g., "Tokyo honyalala 
Hotel" meaning "Tokyo something Hotel": p.15, ^0044, 11.1-2); 

a first detecting step for detecting repeatedly and continuously whether or not there is 
a filled pause (e.g., presence/absence of wild-card expression "honyalala": p. 18, U 0050) in 
the inputted speech; 

{1. The wildcard expression "honyalala", meaning "something", includes a filled pause, i.e., it 
is word with prolonged and vocalized sound ("lala") (p. 16, fl 0045, 11.5-9) and it's length is 
adjustable by the number of 7a' (p. 15, fl 0043; Fig.3 & 7). 

2. Repeatedly detecting whether or not there is a filled pause is performed in the case where 
multiple wild card expressions appearing in a spoken phrase, (p.41, ^ 0151)} 

a recognizing step for recognizing said user's speech (e.g., "Tokyo honyalala Hotel" 
meaning "Tokyo something Hotel") in parallel with said first detecting step, wherein a 
recognition result is generated (e.g., "Tokyo honyalala Hotel": p.18, U 0051); (p.16, U 0044) 
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a second detecting step for detecting a word fragment (e.g., "Tokyo", "Hotel" of 
"Tokyo honyalala Hotel") being a base to be complemented in said recognition result (e.g., 
"Tokyo honyalala Hotel") when there is the filled pause in said first detecting step; (p. 18, 
0052) 

{3. The words "Tokyo", "Hotel" are fragments of the language, e.g., parts of a sentence, 
spoken by the user, (p.8, U 0015-0017)} 

a complementing step for complementing said recognition result, based on the 
detected word fragment; (p.22, 0069) 

an outputting step for outputting said recognition result when no filled pause was 
detected. (p.18 f H0050, II.4-5; see also p.49, Fig.14: S201, S202, S203) 


Claim(s) 
14 


Okuno discloses: 

The recording medium as claimed in claim 13, wherein in said second detecting step, 
the word fragment (e.g., "Tokyo", "Hotel" of "Tokyo honyalala Hotel") is specified by detecting 
a period of the filled pause (e.g., "honyalala") in the speech inputted in said speech input step. 
(p.18, U 0050; p.15, U 0044; p.16, U 0044) 


Claim(s) 
15 


Okuno discloses: 

The recording medium as claimed in claim 14, wherein said word fragment (e.g., 
"Tokyo") is said recognition result before said period of the filled pause (e.g., "honyalala"). 
{1. "Tokyo" is part of the recognition result "Tokyo honyalala Hotel".} 


Claim(s) 
16 


Okuno discloses: 

The recording medium as claimed in claim 13, wherein in said second detecting step, 
said word fragment (e.g., "Tokyo", "Hotel") is specified by detecting a predetermined string 
(e.g., "Stayin") in the result of recognizing in said recognizing step. (p. 18, U 0052) 


Claim(s) 


Okuno discloses: 
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17 


The recording medium as claimed in claim 16, wherein said word fragment (e.g., 
"Tokyo", "Hotel") is the result of recognizing after said predetermined string (e.g., "Stayin"). 
(p.18,1J0052) 


Claim(s) 
18 


Okuno discloses: 

The recording medium as claimed in claim 13, further comprising: 

a selecting step for selecting a candidate for complementing if there are the plurality 
of candidates when said word fragment is complemented by said complementing step, (p.22, 
H 0069, 11.8-1 1 ; p.33, fl 0107, II.6-9) 


Claim(s) 
20 


Okuno discloses: 

The speech complementing method as claimed in claim 7, further comprising: 

recognizing (e.g., recognizing "honyalala") from a middle of a spoken word (e.g., 
'Tokyo honyalala Hotel" meaning "Tokyo something Hotel"); (p. 16, U 0044; p. 18, U 0051) and 

speech-backward complementing (e.g., "Honyalalalalalalalala/Hotel" -> "Stayin 
Hotel") based on the result of said recognizing, (p.45, Fig. 3; p.26, 0082) 
{1. The input speech "Honyalalalalalalalala/Hotel" triggers speech-backward complementing 
(Fig. 3). "Stayin Hotel" is a registered word combination in the vocabulary storage part 202 
that is checked and determined in the speech-backward complementing of 
"HonyalalalalaialalalaMotel" (p. 26, U 0082).} 


Claim(s) 
24 


Okuno discloses: 

The speech complementing method as claimed in claim 7, further comprising: 
presenting a plurality of candidates for complementing to a user; (p.22, 0069, IL8- 

11) 

accepting a selection of a user to complement by the selected candidate for 
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complementing; (p.33, H 01 07, II.6-9) and 

automatically complementing with a candidate when a number of candidates for 
complementing is one. (p.22, H 0069, 11.1-8). 


Claim(s) 
25 


Okuno discloses: 

The speech complementing method as claimed in claim 7, further comprising: 

(e) determining whether or not a wild card key-word is included in the result of 
recognizing just before said filled pause when responding to detecting by (a); (p. 18, 0050) 

(f) executing speech backward complementing (e.g., "Honyalalalalalalalala/Hotel" -> 
"Stayin Hotel") when said filled pause is present; (p.45, Fig. 3; p.26, U 0082) and 

(g) executing speech forwarding complementing (e.g., "Tokyo hoyalalalalalala" -> 
"Tokyo Stayin") when said filled pause is not present, (p.45, Fig. 3; p.26, fl 0082) 


Claim(s) 
26 


Okuno discloses: 

The speech complementing method as claimed in claim 12, further comprising: 

selecting a remaining part (e.g. "Hotel"), wherein the system complemented the part 
of a fragment of a language (e.g., "Tokyo") spoken by the user, after the system displays the 
list of the candidates for complementing and when the user selects the plurality of candidates 
for complementing, by recognizing a speech spoken to read by the user. (p.22 t 0069) 



Claim Rejections - 35 USC § 103 

8. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 
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(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 



9. Claim 19 is rejected under 35 U.S.C. 103(a) as being unpatentable over Okuno in view of Bahl et 
al. (U.S. Patent 5,884,259, hereinafter "Bahl"). 


Claim(s) 
19 


Okuno shows: 

The speech complementing method as claimed in claim 7, further comprising: 
generating a candidate of speech forward complementing, (p.22, 0069) 
Okuno does not show: 

generating a candidate by tracing toward leaves of a word dictionary of a tree 
structure, considering an effective hypothesis as a seed. 

Bahl teaches: 

generating a candidate by tracing toward leaves of a word dictionary of a tree 
structure, (col.1, II.25-43; col.12, 11.41-43) 

It would be obvious to a person of ordinary skill in the art at the time the invention was 
made to modify the speech complementing method of Okuno to include the tree structure for 
representing the candidates because tree structure is an efficient representation of the 
vocabulary in terms of it's phonemes. It would be obvious to use a hypothesis as a seed so 
that speech complement can be performed for nodes along a tree in the case where multiple 
candidates corresponding to multiple wild card expressions are generated. 



Allowable Subject Matter 
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10. Claims 21-23 are objected to as being dependent upon a rejected base claim, but would be 
allowable if rewritten in independent form including all of the limitations of the base claim and any 
intervening claims. 

1 1 . The following is a statement of reasons for the indication of allowable subject matter: 


Claim(s) 
21 


The Drior art fails to show: 

The speech complementing method as claimed in claim 20, wherein said system 
comprises a word dictionary of a tree structure and an entry node table, and wherein the 
method further comprises: 

registering a root from which said recognizing starts in said entry node table; 

adding syllables of words in said word dictionary temporarily to said entry node table; 

obtaining highest hypotheses from the hypotheses which reach to leaves of said tree 
structure and are numbered in order of high likelihood so that the highest hypotheses 
obtained become candidates of complementing for said speech backward complementing. 


Claim(s) 
22 


The prior art fails to show: 

The speech complementing method as claimed in claim 20, wherein said system 
comprises a word dictionary of a tree structure and a entry node table, and wherein the 
method further comprises: 

registering a root from which said recognizing starts in said entry node table; 

selecting candidates for complementing when a top of a word is uttered by the user 
by registering words temporarily on said word dictionary, wherein said words to be registered 
are ones in which the end of an unuttered phoneme string of each candidate is a leaf. 


Claim(s) 
23 


The prior art fails to show: 

The speech complementing method as claimed in claim 19, wherein said system 
comprises a word dictionary of a tree structure and a entry node table, and wherein the 
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method further comprises: 




registering a root from which said recognizing starts in said entry node table; 




adding a seed of a candidate for complementing temporarily to said entry node table, 
wherein said seed is used when said candidate for complementing is generated, as a root, 
selection of the plurality of candidates for complementing by uttering a latter part of a word is 
made possible. 


Conclusion 



12. Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 

§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

13. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

U.S. Patent Documents: 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Tim Lao whose telephone number is 703-305-8955. 
The examiner can normally be reached on M-F, 8:30am-5pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Doris To can be reached on 703-305-4827. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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